Two simple models of classical heat pumps 
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Motivated by recent studies on models of particle and heat quantum pumps, we study similar 
simple classical models and examine the possibility of heat pumping. Unlike many of the usual 
ratchet models of molecular engines, the models we study do not have particle transport. We 
consider a two-spin system and a coupled oscillator system which exchange heat with multiple 
heat reservoirs and which are acted upon by periodic forces. The simplicity of our models allows 
accurate numerical and exact solutions and unambiguous interpretation of results. We demonstrate 
that while both our models seem to be built on similar principles, one is able to function as a heat 
pump (or engine) while the other is not. 
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The idea of constructing miniature versions of engines, 
motors and pumps has been an interesting one. The ear- 
liest theoretical construct of such a device is probably 
Feynman's pawl-and-ratchet model discussed in In 
this article Feynman uses this simple microscopic model 
to demonstrate why a Maxwell's demon cannot work. In 
the same article he also shows how this model can be used 
to construct a microscopic heat engine and discusses its 
efficiency. There have been a number of recent detailed 
studies on the pawl-and-ratchet model and some subtle 
flaws in Feynman's original arguments have been pointed 
out [1, 3 . A different class of ratchet models have also 
been studied in In these models Brownian particles, 
kept in an asymmetric periodic potential and acted upon 
by periodic time-dependent forces, are found to exhibit 
directed motion. A number of variations of this model 
has been studied 0]. Among its applications it has been 
proposed that this could provide a mechanism of trans- 
port of motors in biological cells [6] . 

Ratchet models which work on somewhat different 
principles are models of quantum pumps which are re- 
cently being studied theoretically [7(] and have also been 
experimentally realized 0]. A typical and simple exam- 
ple of such a device would be two coupled quantum dots 
each separately in contact with particle reservoirs which 
are at the same chemical potential. One applies AC gate 
voltages vi = vq cos(r2i) and V2 = vq cos{ilt + (f) to the 
two dots respectively. This leads to a net flow of particle 
current between the two reservoirs whose sign depends 
on the phase 0. An essential ingredient seems to be a 
periodic variation of at least two parameters such that 
the area enclosed in parameter space is non-zero. Since 
these pumps also work at zero temperature it appears 
that noise is not an essential feature, which is unlike the 
case for usual ratchet models. Motivated by the quantum 
particle pump model, Segal and Nitzan have proposed a 
model for a heat pump [9] . In this model a molecule with 
two allowed energy levels interacts with two heat reser- 
voirs kept at different temperatures. The energy levels 
are modulated in a periodic way. Thus unlike the particle 
pump model here only a single parameter is varied. How- 



ever an asymmetry is incorporated by taking reservoirs 
with different spectral properties and different couplings 
to the molecule. This seems to lead to the desired pump- 
ing of heat from the cold to the hot reservoir. 

Motivated by the quantum pump model, in this paper, 
we examine classical models which have the same basic 
design as the quantum version. We consider two differ- 
ent models: (i) a spin system consisting of two Ising spins 
each driven by periodic magnetic fields with a phase dif- 
ference and connected to two heat reservoirs and (ii) an 
oscillator system of two interacting particles driven by 
periodic forces with a phase difference and connected to 
two reservoirs. In both cases we analyze the possibility 
of the models to work either as pumps or as engines. Our 
main result is that the spin system can work both as a 
pump and as an engine. On the other hand the oscillator 
model fails to perform either function. 

Our first model consists of two Ising spins driven by 
time-dependent magnetic fields hL{t) and hB.(t) respec- 
tively and each interacting with separate heat reservoirs. 
The Hamiltonian of the system is given by 

H = -Jaia2 ~ hL{t)(Ji - hR{t)a2 , cfi^2 = ±1 (1) 

where J is the interaction energy between the spins. 
The magnetic fields have the forms hL{t) = /locos(ilt) 
and hii{t) — /ioCOs(J7t -I- 0). The interaction of each 
spin with the heat baths is modeled by a stochastic 
dynamics. Here we assume that the time-evolution of 
the spins is given by Glauber dynamics general- 
ized to the case of two heat baths, with temperatures 
Tl and Tr. Thus the Glauber spin fiip rates and 
r^, for the two spins respectively, are given by r^_^^^ — 
r{l - lLcri(T2){l - VLO-i) and rf^^^ = r(l - 7fl:cri(T2)(l - 
i/H(T2) where jl,r = tanh(J/A:BTi__R), vl,r = 
ia,n\i{hL^ji/ ksTLji) and r is a rate constant. The mas- 
ter equation for evolution of the spin distribution func- 
tion P = [P(+,+,t),P(-,+,t),P(+,-,t),P(-,-,t)]^ 
is then given by: 



0.003 



0.002 - 



0.001 




-0.001- / 



-0.002 



0.04- 



0.02 



0- 



-0.02 ■ 



-0.04 



0.004 




It/2 It 371/2 2lt 



7t/2 



37t/2 



In 



FIG. 1: (Color online) Plot of gL, Qfl, w versus with both 
baths at the same temperature. Inset shows the currents for 
the case where the right bath is slightly colder. 



FIG. 2: (Color online) Plot of gz,, gj?, w versus i\> for parameter 
values chosen such that the model performs as an engine. 
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We define Ql, Qr to be the rates (averaged over the 
probabihty ensemble) at which heat is absorbed from the 
left and right baths respectively while Wl, Wr are the 
rates at which work is done on the left and right spins 
by the external magnetic field. These can be readily ex- 
pressed in terms of the spin distribution function and the 
various transition rates. Thus we find: 

Ql = ^ P(ai, (72, i)r^,,, ASi ((71,(72) 

Cl ,fT2 

Qr = ^ P((7l,(72,i)r^^,,AS2((7l,(72) 

Wl = -((7l) ilL = -hL ^ (7lP((7l,(72,t) 

c 1 ,U2 

Wr = -((72) hR = -llR (72P((7l,(72,i) , (3) 

0'l,0-2 

where Ai?i = 2 {J(Ji(T2 + ^lO'i) and /S.E2 — 2 {J(Ji(T2 + 
hR(J2) are the energy costs in flipping the first and second 
spin respectively. The average energy of the system is 
given hy U = (H) = Eai.^a '^('^i' '^2)-P(cti, 0-2, t). It is 

easy to verify the energy conservation equation: U — 
Ql + Qr + Wl + Wr. Note that even at long times the 
steady state distribution P remains time-dependent. We 
will also be interested in the following time averaged rates 
of heat exchanges and work done, evaluated in the steady 
state: qL,R = 7 Jo Ql,R dt ,wl,r = 7 Jq Wl,r dt, 
where r = 27r/r2 is the time period of the driving field. 

We numerically solve the master equation Eq. ^ and 
then evaluate the various steady-state energy exchange 



rates ql.r. and wl.r- In all our numerical calculations 
we set r — 0.5 and J /ks = 1 and all other quantities 
are measured in these units. In Fig. ^ we consider the 
parameter values Tl —Tr = 0.5, ho = 0.25, t — 225 and 
plot qL , Qr and w — wl + wr as functions of the phase (j). 
It can be seen that, for certain values of the phase, both 
Ql and qr are negative while w is positive. Following 
our sign conventions, this means that all the work from 
the external driving is getting dissipated into the two 
baths. More interestingly we find that for certain values 
of the phase we can get > and qr < which means 
that there is heat flow from the left reservoir to the right 
reservoir. The direction of heat flow can be reversed by 
changing the phase. From continuity arguments it is clear 
that this model can also sustain heat flow against a small 
temperature gradient. Thus the inset of Fig. ([T|) shows 
the currents when the right reservoir is kept at a slightly 
lower temperature Tr = 0.499. In the absence of any 
driving we would get a steady current ql = —q_R. = 1-41 x 
10~^ from the left to right reservoir. In the presence of 
driving and at a phase value </) = 2.2 we get qr = 3.674 x 
10~^, cIl = —1-025 X 10^"^ which means that heat flows 
out of the cold reservoir. Thus we see that our model can 
perform as a heat pump or a refrigerator. Similarly we 
find that the model can also perform like an engine and 
convert heat to work. This can be seen in Fig. ^ where 
we consider the parameter values Tl = 1.0,Tr = 0.1, 
ho = 0.25, r = 190. In this case we find that for certain 
values of (j) we can have w < which means that work 
is being done on the external force. For typical values of 
parameters that we have tried we find that the efficiency 
of the engine is quite low. For example for Fig. Q with 
(t) = O.Ttt, wc find ?7 = \w\/qL ^ 1-75 x 10"^ 

Finally in Fig. ([3]) we plot the time-dependent energy 
transfer rates given by Eq. ([3]) for parameter values cor- 
responding to the refrigerator and engine modes of oper- 
ation. In both cases the initial configuration was chosen 
with P{+,+,t = 0) = 1. At long times we see that all 
quantities vary periodically with time with the same pe- 
riod r as the driving force. Fig. ^ corresponds to the 
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FIG. 3: (Color online) Plot of Ql, Qr, as a function of time 
for parameters corresponding to pump and engine (inset). 



following matrix form: 

MX = -TX + ri{t) + f{t) 



(5) 



where X = [xi,X2Y ■, V = [??L,??fl]'^, / = 
[/o cos(r2i), /o cos(r2t + (j))]'^ , M and F are diagonal ma- 
trices with diagonal elements m and 7 respectively and 
$ is the force constant matrix. The steady state solution 
of this equation is: 



X{t) 
where Xjv(t) 

with G{lo) 



XN{t)+XD{t) , 

duje~''^'G{uj)fl{oj) 



(6) 



parameter values Tl = 0.5, Tr = 0.499, ho = 0.25, t = 
225 and (j) = 2.2 while the inset corresponds to the engine 
parameters Tl ^ 1.0, Tr = 0.1, ho = 0.25, r = 190 and 
= 2.2. 

The second model of our engine consists of two parti- 
cles which separately interact with two reservoirs kept at 
different temperatures. The particles interact with each 
other and are also driven by two external periodic forces 
with a phase difference. We consider the system to be 
described by the Hamiltonian 
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(4) 



The two particles are acted on by external periodic forces 
given by /L(t) = focos{nt) and fii{t) = /o cos(fii + <j)) 
respectively, where is a phase difference. The effect of 
the heat baths at temperatures and Tr is modeled by 
Langevin equations. Thus the equations of motion are 

mx\ = -(fc + kc)xi + kcX2 - 72:1 +riL + fhit) , 
mx2 = -~{k + kc)x2 + kcXi - 7x2 + r/R + fR(t) , 

where the two noise terms are Gaussian and uncorre- 
lated and satisfy the usual fluctuation-dissipation rela- 
tions {vLM{t)VL.R{t')) = 2kBTLMjS{t - t'). Multiply- 
ing the two equations above by xi and X2 respectively 
and adding them up we get: Ti — (— 7ii -1- ?7L)ii + 
(-7x2 + 'nR)x2 - fL{t)xi - fR(t)x2, which has the ob- 
vious interpretation of an energy conservation equation. 
Averaging over noise we get U ~ + Qr + Wl + Wr. 
where the various energy exchange rates have the same 
interpretations as in the previous discussion and are 
given by Ql = ((-7^1 + ,Qr = ((-7^2 + 

ilR)i2) ,Wl = -{fLXi) ,Wr = -{fRX2). As before 
we define the average energy transfer rates in the steady 
state QLjQRtWljWr. The present model being linear, it 
is straightforward to exactly compute these as we now 
show. 

We first obtain the steady-state solutions of the equa- 
tions of motion. We write the equations of motion in the 



and f] = /^dwe-*'^* r]{t), f = {1,6-*"^}^. It is easy 
to see that the matrix G(w) has two independent ele- 
ments and we denote them as A{lu) ~ G\\ = G22 = 
[k + kc — muj'^ — iju!]/[{k + kc — muP' — 170;)^ — /c^] and 
= G12 = G21 = fcc/[(fc + kc- ■muP' - i^ujf - fc^]. 
Using the above solution in Eq. ^ , and after some bit of 
algebraic simplifications, we obtain the following results: 



<1L 

QR 

Wl 
Wr 



Ai{n) + Bi{n) cos(0) + D{n) sin((/.) 



2 

kBlkljTL ~ Tr) 

2(mfc2 + (fc + kc)i^) ' 



Ai{n) + Bi{n) cos(0) - D{n) sin((/.) 



2 

kBlkljTR - Tl) 
2{mkl + [k + kc)i^) ' 

4^ [ Ai{U) + Bi{n) cos(0) - Br{Vl) sin(0) ] , 



Ai{n) + Bi{n) cos(0) + BR{n) sin(0) ], (7) 



where Ar^ Aj, Br, Bj arc the real and imaginary parts 
of A and B respectively and D{n) = 2-f^n'^kc/Z{n) 
where Z(n) = \{k + k^ - mfi^ - i-fil)'^ - ^cP- From the 
expressions in Eq. ([7]) it is clear that the heat transfer 
rates can be separated into deterministic parts (depend- 
ing on the driving strength /q) and noisy parts (depen- 
dent on temperature of the two reservoirs). The work 
terms are temperature independent. We now note that 
the deterministic parts of ql and qr, are both negative. 
This can be shown by using the facts that Aj > and 
Aj-Bj-D^ = ^^n''[{k + kc-mnY+l^^''-k'',]yZ^ > 
0. This means that for Tl > Tr, we always get qr < 
and hence we can never have heat transfer from the cold 
to the hot reservoir. Thus this cannot work as a heat 
pump. Also we note that while wl and wr, can individ- 
ually be negative, the total work done wl + wr is always 
positive. This means that this model cannot work as an 
engine either. These conclusions remain unchanged even 
if we define work as Wl = (/l^i), Wr = {JrX2)- 
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FIG. 4: (Color online) Plots of heat transfer and work done 
as a function of phase difference <j) in the two particle model. 
Here n = 27r/3. 



In Fig. ([4]) we plot the dependence of the rates of 
heat transfer and work done in the system on the phase 
difference <j). The figures correspond to the parameter 
values k — 2, kc — i, m = l, /o = l, 7=1 and 
= Tfj = T . The plots are independent of the tem- 
perature T. Note that the only effect of the driving is to 
pump in energy which is asymmetrically distributed be- 
tween the two reservoirs. The asymmetric energy trans- 
fer into the baths is an interesting effect considering that 
there is no inbuilt directional asymmetry in the system. 

In this model the heat baths and the external driving 
seem to act independently on the system. It is clear that 
the linearity of the model leads to this separability of the 
effects of the driving and noise forces and this could be 
the reason that the model is not able to function as a 
heat pump. Hence it is important to consider the effect 
of nonlinearity. We have numerically studied the effect of 
including a nonlinear part of the form a[x\ -I- a;| -f (xi — 



a^2)^]/4 in the oscillator Hamiltonian. From simulations 
with a large range of parameter values we find that the 
basic conclusions remain unchanged and the model does 
not work either as a pump or as an engine. 

In conclusion, we have studied two models which have 
the same ingredients as those on which recent models of 
quantum pumps have been constructed. We find that 
the first model performs as a heat pump to transfer heat 
from a cold to a hot reservoir. Thus pumping is not 
an essentially quantum-mechanical phenomena. Also our 
model performs as an engine to do work on the driving 
force. It is useful to compare our model with the other 
well-studied microscopic model of a engine, namely the 
Feynman pawl-and-ratchet. Recent detailed studies have 
shown that this model can function both as an engine and 
as a refrigerator One difference of this model from 
ours is that there is no periodic external driving. However 
this also means that in order for the model to work in a 
cyclic way, at least one of the degrees of freedom has to 
be a periodic (or angular) variable. This may not always 
be a desirable feature in realistic models. Surprisingly 
our second model, though apparently built on the same 
principles, fails to perform either as a pump or as an 
engine. 

The important difference between microscopic models 
of heat engines, such as those studied here, and usual 
thermodynamic heat engines is that here the effects of 
thermal fiuctuations are important. A second difference 
is that here the system is simultaneously in contact with 
both the cold and hot baths. The understanding of these 
microscopic models requires the use of noncquilibrium 
statistical mechanics and there are currently no general 
principles as in classical thermodynamics. It is clear that 
further studies are necessary to understand the pumping 
mechanism in simple models of molecular pumps and this 
can perhaps lead to more realistic and practical models 
of molecular pumps and engines. 



[1] R. Feynman, R. Leighton, and M. Sands, The Feyn- 
man Lectures on Physics (Adison-Wesley, Reading Mas- 
sachussets, vol.1, chap. 46, 1966). 

[2] J. M. R. Parrondo and P. Espanol, Am. J. Phys. 64, 1125 
(1996); M.O.Magnasco and G.Stolovitzky, J. Stat. Phys. 
93, 615 (1998). 

[3] K. Sekimoto, Jr. Phy Soc. Jpn. 66, 1234 (1997); 
T. Hondou and F. Takagi, J. Phy Soc. Jpn. 67, 2974 

(1998) ; H. Sakaguchi, J. Phy Soc. Jpn. 67, 709 (1998); 
C. Jarzynski and O. Mazonka, Phys. Rev. E 59, 6448 

(1999) ; Y. Lee et ai, Phys. Rev. Lett. 91, 220601 (2003). 
[4] M. O. Magnasco, Phys. Rev. Lett. 71, 1477 (1993); I. 

Derenyi and T. Vicsek, Phys. Rev. Lett. 75, 374 (1995); 
F. Jiilicher, A. Ajdari, and J. Prost, Rev. Mod. Phys. 
69, 1269 (1997); P. Reimann, Physics Reports 361, 57 
(2002); R. D. Astumian, Science 276, 917 (1997). 
[5] T. Feldmann, E. Geva, R. Kosloff, and P. Salamon, 
Am. J. Phys. 64, 485 (1996); I. Derenyi and R. D. Astu- 
mian, Phys. Rev. E 59, 6219 (1999); A. Gomez-Marin 



and J. M. Sancho, Phys. Rev. E 71, 021101 (2005); M. C. 

Mahato, T. P. Pareek, and A. M. Jayannavar, Int. J. 

Mod. Phys. B 10, 3857 (1996). 
[6] R. D. Astumian and I. Dernyi, European Biophysics 

Journal 27, 474 (1997). 
[7] M. Buttiker, H. Thomas, and A. Pretre, Z. Phys. B. 

94, 133 (1994); P. W. Brouwer, Phys. Rev. B 58, 

10135 (1998); L. Arrachea, Phys. Rev. B 72, 125349 

(2005); L. Arrachea, Phys. Rev. B 72, 121306(R) (2005); 

M. Strass, P. Hanggi, and S. Kohler, Phys. Rev. Lett. 95, 

130601 (2005); S. Kohler, J. Lehmann, and P. Hanggi, 

Phy Rep. 406, 379 (2005); A. Agarwal and D. Sen, J. 

Phys. Condens. Matter 19, 046205 (2007). 
[8] M. Switkes et ai, Science 283, 1905 (1999); P. Leek et 

ai, Phys. Rev. Lett. 95, 256802 (2005). 
[9] D. Segal and A. Nitzan, Phys. Rev. E 73, 026109 (2006). 
[10] R. Glauber, Jr. Math. Phys. 4, 294 (1963). 
[11] C. van den Broeck, R. Kawai, and P. Meurs, Phys. 

Rev. Lett. 93, 090601 (2004); C. Van den Broeck and 



R. Kawai, Phys. Rev. Lett. 96, 210601 (2006). 



